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Abstract —Uncertainty Principles for concentration of signals 
into truncated subspaces are considered. The “classic” Uncer¬ 
tainty Principle is explored as a special case of a more general 
operator framework. The time-bandwidth concentration problem 
is shown as a similar special case. A spatial concentration of radio 
signals example is provided, and it is shown that an Uncertainty 
Principle exists for concentration of single-frequency signals for 
regions in space. We show that the uncertainty is related to the 
volumes of the spatial regions. 

I. Introduction 

Signal processing, at its most fundamental level, concerns 
the extraction of information (signal) from a system under 
various constraints. Typically, communication engineers con¬ 
sider the signal as being embedded in noise, and although the 
signal may have spatial, temporal or bandwidth constraints, 
they are usually concerned with noise as the limiting factor. 
In the following work, we will consider a fundamental limit to 
signal extraction without impediments due to noise. We shall 
pose the following question: 

Given a signal (wavefield) which has energy in one volume 
Va, how well can we constraint that signal to have energy in 
another volume Vb? 

This question motivates examination of Uncertainty Prin¬ 
ciples (UP’s). We may regard uncertainty as a basic limit on 
signal information extraction, without requiring a model for 
noise - since any noise can only further hinder our efforts. 
Uncertainty Principles have gained great popularity since 
Heisenberg. The famous example is Heisenberg’s Uncertainty 
Principle: it is impossible to exactly measure the location and 
momentum of a particle simultaneously. This is a special case 
of a more general framework, which may be applied (via 
various Hilbert space techniques) to a range of scenarios. 

In a communication theory setting, a similar UP has been 
well known: that a signal cannot be arbitrarily confined in 
both time and frequency. The reader is directed to [1] for 
a discussion. The work of [2—4] has formalised this result, 
although without explicit reference to the operator theoretic 
nature of the problem 1 . The time-bandwidth concept of a 
temporal signal provides us with a great deal of intuition and 
we shall draw heavily on the classic works. 

There is a significant distinction between essential dimen¬ 
sionality results such as [1,6] and uncertainty results [7,8]. 
Dimensionality results (eg. 2 WT) may be seen as a counting 
of the number of degrees of freedom a signal (or function) has 
within a particular set of constraints - much like the rank of a 

'Landau provides some work in this regard [5]. 


matrix. Uncertainty tells us to what extent a signal will achieve 
all constraints, and how uniquely that solution is specified by 
the constraints. 

The remainder of this paper is arranged as follows: In 
Section |n] we collate classic results in uncertainty and for¬ 
mulate UP’s in terms of Operator Theoretic forms. Section HTTl 
develops an Uncertainty Principle for communication between 
volumes with a particular form of operator channel. We 
provide a free-space example. Conclusions are drawn, and 
proofs are consigned to the appendix. 

II. Uncertainty Principles: a review 

Before explaining the Uncertainty Principle, we develop 
some relevant notation. 


A. Notation 


Following Selig [7], let hi be a Hilbert space with inner 
product (•,•) and norm || • || = (-,-) 1 / 2 . Further, let A be 
a linear operator with domain U(A) C hi and range in hi. 
We then define the normalised expectation value, t^(/) and 
standard deviation (uncertainty), ctA(f) of the operator A with 
respect to / G D(A) to be [7] 


M/) = ||(A-ta(/))/||. 


(1) 

( 2 ) 


The adjoint of operator A, A '' is defined using the following 
equation [9] 

{Ax, y) = (x, A^y) Vx G V(A),y G D(A^). (3) 


Furthermore, A is said to be Hermitian or self-adjoint if A = 
A'. For a self-adjoint operator 


(Ax,y) = {x,Ay) Vx,y£V(A). (4) 

Any operator that obeys equation 0] is said to be symmetric. 

Given two linear operators A and B with domains 'D(A) 
and T>{B) respectively, the commutator is defined as 

[A, B] = AB - BA (5) 


and the anti-commutator is defined as 


[A, B}+ = AB + BA (6) 

with domains V{AB) fl 'D(BA) for either one. Operators A 
and B are said to commute with each other if [A, B] = 0. 
Otherwise they are called non-commutative operators. 



Also, let L 2 [M] be the set of all square integrable functions 
defined on the real line with norm ||/||2 = (/, Z) 1 ^ 2 - Here the 
inner product (•, •) is defined as 

/ OO 

f(t)g(t)dt. (7) 

-OO 


whenever these integrals exist. Then 

AxAlu > 7r/2, 
where equality is attained iff 

f{x) = ( r / 7r ) 1 /4 e i0, o x e -r(x-x o ) 2 /2 


Consider \\f\\ 2 as the energy of the function / £ L 2 [R]. The 
angle between two non-zero functions / and g is defined as 


8{f,g) = cos 1 


\\fh\\g\W 


We also define 

/ OO 

f{x)e~ iujx dx 

-OO 


( 8 ) 

(9) 


to be the Fourier transform of f(x) whenever this integral 
exists. 


B. Classic Uncertainty Principle 

The classical uncertainty principle states that the values of 
two non-commuting observers such as position and momentum 
cannot be precisely determined in any quantum state. That is, 
the standard deviation of two non-commuting operators can¬ 
not be made arbitrarily small simultaneously. The following 
theorem is a general statement of this phenomenon. 

Theorem 1 (theorem 3.4,[7]): If A and B are two symmet¬ 
ric operators on a Hilbert space IT, then 

\\(A-a)f\\\\(B~b)f\\>l{\([A,B}fJ)\ 2 

+ \([A-aI,B-bI] + f,f)\ 2 y /2 (10) 

for all / £ V{AB) n V{BA) and all a, b £ R. Equality holds 
precisely when {A — a) f and {B — b)f are scalar multiples of 
one another. 

A special case of this theorem bounds the standard deviation 
of two non-commuting operators as explained in the following 
corollary which we get by substituting a = cr^if) and b = 

<tb(/) in theorem n 

Corollary 1.1: If A and B are two symmetric operators on 
a Hilbert space IT, then 

*A(f)Mf)>lV\([A,B]f,f )\ 2 (11) 

for all / £ V{AB) fl U(BA) and all a, b £ R. Equality holds 
precisely when {A — TA(f))f and ( B — TB(f))f are scalar 
multiples of one another. 

A special case of this corollary is the following Heisenberg 
Uncertainty Principle which states that a function and its 
Fourier transform cannot be arbitrarily localised. 

Theorem 2 (theorem 6.1, [7]): Let / £ L 2 (K), ||/|| = 1 
and set 

x° = J x\f{x)\ 2 dx (jj 0 — J u)\f{u:)\ 2 du> 

Ax = J {x — x 0 ) 2 \f(x)\ 2 dx Auj = J (lu — u) 0 ) 2 \f(u})\ 2 duj 


for any r > 0. 

Theorem |3 gives valuable insight into how localized a 
function can be in both time and frequency. If one defines 
Ax and Aw to be the measure of approximate time duration 
and bandwidth of the signal respectively, then Theorem|2]says 
that the product of time duration and bandwidth of a function 
is bounded from below by n/2: if the time-spread gets very 
small, the frequency-spread must be large and vice-versa. 

Though a good qualitative tool, this is inadequate for the 
purposes of signal processing. Theorem |2] does not answer 
the question: given a bandlimited function (i.e. fioj) = 0 for 
u> (f [—fl, fl]) how much of the energy of / is ‘concentrated’ 
in finite duration of time. This would be useful in answering 
the question: “given a bandlimited channel, how much of the 
transmitted signal can a receiver measure over a finite period 
of time?” 


C. Uncertainty principle for energy concentrations 

Landau and Poliak [3] proposed that for the purposes of 
signal processing, a more relevant uncertainty principle should 
use sharper measures of concentrations in time and frequency 
than the ones used in Heisenberg’s principle [3]. To help 
derive their uncertainty principle [3] define V = {/ : / £ 
L 2 [R], f{t) = 0 V|f| > T/ 2} to be the class of all time-limited 
functions and B = {/ : / £ L 2 [R],/(w) = 0 V|tu| > fl} to 
be the class of all band limited functions. Here, /(w) is the 
Fourier transform of /(f) as defined in equation [3 Also T, 
the time duration and W = Tl/2n, the bandwidth are fixed for 
the remainder of this paper. It is easy to prove [2] that V and 
B are complete subspaces of L 2 [R]. 

Define the projection operators 
B : L 2 [R] —> B and D : L 2 [R] —> T> as follows 

D ^> = { T W > T /2 < 12 > 

Bfit) = ^~ [ fiuY^dw ( 13 ) 

J-n 


Using these operators we can calculate the fraction of 
energy, a 2 of any function f £ L 2 [R1 in the finite duration of 
time [—T/2, T/2]. 


2 _ \\Df\\l 

11/112 ' 


(14) 


Similarly, we can calculate, /3 2 , the fraction of energy of a 
function in a finite bandwidth [—fl, fl]. 


,2 . \\Bf\\l 

11/112 ' 


(15) 


[3] show that a and (3 cannot be arbitrarily large. Specifically, 
they prove 






B 



Fig. 1. Subspaces B and T>, with minimum angle 9. Point of intersection is 
0 vector. Here. B,T> C R 3 , below. B,T> CH with dimension Nq. 


Theorem 3 (theorem 2, [3]): Let 0 < a,/3 < 1. Then there 
exists a function / £ L 2 [R], ||/||2 = 1 with H-D/H 2 = a and 
||S /||2 = ft if and only if (a, ft) 7 (0,1) or (1, 0) and 

cos -1 a + cos -1 ft > cos -1 \/Aq 


waves within the receiving volume we will need to consider 
restrictions of / and / to Vp and Vr respectively. Let \V be 
the characteristic (truncation) operator: 


Xvf(r) 


/(r) r £ V, 

0 otherwise. 


(17) 


We say that a function / is e-concentrated in volume V in 
some norm || ■ || if 

WxvfW 2 > 1 2 

ll/ll 2 - 

With this notation in place we can now look at the set 
of functions V that a receiver can measure and the set of 
functions B a transmitter can generate: 

V = {f:f = xv R g,g€L 2 [R 3 )} (18) 

B = {f:f = V X v T g,g&L 2 [R 3 }}. (19) 


where, Ao is the largest eigenvalue of the equation 

Xip = BDip 

This theorem constrains the possible values of a and ft because 
Ao < 1 [2]. So any function cannot have arbitrarily large 
fractions of energy in both a finite-time duration and a finite- 
frequency bandwidth. We will show in the next section that 
this theorem is a special case of a more general theorem just 
like the Heisenberg Principle is a special case of the classical 
uncertainty principle as alluded to by [3], We show that this 
more general theory can be used to understand communication 
through arbitrary channels. 

III. Communication between finite volumes and 

THE UNCERTAINTY PRINCIPLE 

The derivations above are for a function defined on the 
real line and its Fourier transform, however the principle can 
be extended to arbitrary transforms defined on R". The key 
property is that the subspaces B and V form nonzero minimum 
angles. Before deriving these results, we explain the physical 
model. 

A. Physical Problem and Notation 

Consider communication using scalar waves between two 
volumes Vr, Vr C R 3 , where R 3 is the standard three 
dimensional Euclidian space. Let L 2 (V) be the space of all 
square integrable functions defined on volume V C R 3 with 
the standard inner product. Following [10], assume there are 
sources 2 / £ L 2 (R 3 ) that generate waves / £ L 2 (R 3 ) 
governed by some transformation T : L 2 (R 3 ) —► L 2 (R 3 ): 

/ = 17 . (16) 

Here, L 2 [R 3 ] is the set of all square integrable functions 
defined on R 3 with the standard inner product. If we only 
have sources in the transmitting volume and can only measure 

-This is the time independent wave function. The complete time-dependant 
wave function, for exponential time dependence may be written as -F(r, t) = 
/(r) exp{zcjf}. However the theory can easily be extended by defining 
volumes V C M 4 where the fourth coordinate is time. 


If the spaces V and B are complete, we can define projection 
operators D : L 2 [R 3 ] —► V = xv R and B : L 2 [R 3 ] —> B. Note 
that B 7 T'xvt ■ We can also define an angle between these 
two subspaces as follows: 

0(B,V)= inf 0(f,g). (20) 

faB,gdV 

fA0,gA0 

B. Uncertainty Principle for arbitrary subspaces 

We can again think of JJ/IH as the energy of a function. 
Then a 2 = H-D/II 2 /II/II 2 * s the fraction of energy of / in 
the space of receiver functions and ft 2 = ||S/|||/||/||| is the 
fraction of the energy of / in the space of transmitter functions. 
We can now prove the uncertainty principle that constrains the 
possible range of values that a and ft can take provided the 
subspaces B and V form a non-zero minimum angle. 

Theorem 4: Let subspaces B and V form a non-zero min¬ 
imum angle 0<j then 

cos -1 a + cos -1 ft > 9 q. (21) 

This theorem has a very simple physical interpretation. If 
the space of all the functions that a transmitter can generate 
and the space of all the functions a receiver can receive form a 
non-zero minimum angle then there exist no functions that can 
have arbitrarily large fractions of energy in these two spaces of 
functions. We can calculate this minimum angle by calculating 
the norm of the operator ||Z?ZA ||2 and this is the subject of our 
next theorem. 

Theorem 5: The angle between two complete subspaces B 
and V with projection operators B and D is 

9(B,V) = cos- 1 \\BD\\ 2 (22) 

C. General Uncertainty principle 

We prove a slightly modified version of the general uncer¬ 
tainty theorem proved in [11]. In the following L 1 [V], T 2 \V] 
and L°°[V] are spaces of functions defined on V C R 3 with 
finite Lx (|| • ||i = f v | • |), L 2 (|| • || 2 = f v | • | 2 ) and L x 
(II • 11 00 = supy | • |) norms. 



Theorem 6 (Generalized Uncertainty): Suppose T(/) = / 
and / 6 L 1 [M 3 ]fj L 2 [R 3 and / £ L 2 [R 3 ]f] L°°[R 3 ] and 
satisfies 

1 ) i /||2 = a ||/|| 2 

2) H/lloo < /3||/||i- 

Also, suppose / is cr-conccntrated to Vt in the L\ norm and 
/ is r^-concentrated to Vr in the L 2 norm. Then, 

|V T ||V*|a 2 /3 2 >(l-e r ) 2 (l-4) 

The theorem has a very simple physical interpretation for 
communication between finite volumes. Firstly, by requiring 
||/||2 = a ||/|| 2 , we ensure that the energy of the received 
signal is proportional to that of the transmitting signal. So a 
determines the attenuation in the signal and we expect it to be 
greater than 1. Secondly, \\f\\oo < /3||/||i can be thought of as 
a stability condition (i.e. bounded input gives bounded output). 
As a direct corollary to Theorem [ 6 ] we obtain an uncertainty 
principle for communicating volumes 

Corollary 6.1 (Volumetric Communication Uncertainty): 
Let the transmitting volume Vr be finite, and the conditions 
for Theorem [h] hold. Then 

\V T \\V R \a 2 p 2 >(l-e 2 R ) 

Since f must be perfectly concentrated in Vr and so er = 0. 
ie. the maximum fraction of energy that can be inside the 
receiving volume is bounded from above. 

IV. Conclusions 

We investigated Uncertainty Principles for the transmission 
of waves between volumes, using a generalised version of 
the classic Heisenberg UP. We have provided a framework 
for future UP developments where volumetric constraints on 
signals induce a limit to signal resolution. Application of 
operator-theoretic tools has provided a means to develop 
concent 


Appendix 

Proof: [outline theorem ^ Let A. IT a, b and / be as 
stated in the theorem. We summarize [7]. From the Cauchy- 
Schwarz inequality we have 

2 ||(B - b)f \\||(A - a)/|| = 2 [3{<(£ - b)f , (A - a )/)} 2 
+ 3£{<(£-/>)/, (A-a )/)} 2 ] 1 / 2 (23) 
3?{z} and A{ 2 } denote real and imaginary parts of z. 

2 - b)f, (A - a)f)} = ([A, B]f, f) (24) 

Using symmetry of the operators and the fact that scalar 
multiplication commutes with all linear operators. Similarly 

2 MB ~ b)f , (A - a)f) = ([A — aI,B — 67]+/, /) (25) 

Re-arranging i2A\ . (1251 . (1231 completes the proof. ■ 

2 National ICT Australia is funded through the Australian Government’s 
Backing Australia’s Ability initiative, in part through the Australian Research 
Council. 


Proof: [outline Theorem |3 The theorem is proved triv¬ 
ially by noting that cta(/) = Ax and ctb(/) = Aiu/27r [7]; 
where. A/ = •/ and Bf = —if [7]. ■ 

Lemma 1: Let /, 3 ,/i £ L 2 [R 3 ]. Then, 


9(f, 9) < 9(f h) + 6»(g, h). (26) 

Proof: [Proof of Lemma [3 Let / = //||/|| 2 - Then 


0{f,9) = cos 


-1 5H(||/|| 2 /,||<M} 


= cos 




= 8{f, 9 ) 


(27) 


Let 9(f , g) f 0. Otherwise, there is nothing to prove. Also, let 
S = spanlf, g} be the space of all functions spanned by / 
and g. Then this space is complete and we can write h as [9] 

h = + h^~, 

where, £ S and h is orthogonal to both / and g. Because 
||/iH || 2 < || 6||2 = 1 we have 

0(f, h) = 0(f, h) = cos” 1 »{(/, h)} = cos " 1 K{(/, h 11 )} 



= e(fM) (28) 


Similarly, 

9(g,h)>9(g,h 11 ) (29) 

Now, if 9(g , /iH) =0 the proof is trivial as 
0(f, 9) = 0{f, 9) = <?(/, h") < 9(f, h) < 9(f, h ) + 9(g : h). 
If 0 ( 3 ,/iH) f 0, let 

^i=/iU/||/i"|| 2 , (30) 

h, = S-Ma.k) (31) 

||(3 - hi(g,hi)\\ 2 

be two unit vectors that are orthogonal to each other and whose 
span is S. We can therefore write. 


/ = aji\ + a 2 h 2 (32) 

3 = bihi + b 2 h 2 (33) 


Where, ai = a[ + ia'{,a 2 = a' 2 + %a!fb\ = b[ + ib'{ and 
b 2 = b' 2 + ib 2 are complex numbers. From the orthogonality 
of hi and h 2 we have 

cos 9(f ,h^) = a[ (34) 

cos 0 ( 3 , /iH) = b[ (35) 

cos 9(f g) = 5R{aJ&i + a 2 b 2 } (36) 

= ai hi + a 2 b 2 + a![f[ + (37) 

a* is the complex conjugate of ai. From orthogonality of h± 
and h 2 and / and 3 have unit norm 

ai 2 + of + a 2 + a" 2 = 1 (38) 

hi 2 + 6f + hi 2 + b 2 2 = 1 (39) 





Consider (a",a' 2 , a'i) and (b",b' 2 , b 2 ) as two three dimensional Using cos 9(f, g) from the proof of the last theorem, we can 
vectors, the Cauchy-Schwarz inequality gives write 


\Ja " 2 + a'i 2 + a 2 b " 2 + b 2 2 + b 2 > \a"b" + a'ib'i + a 2 b' 2 \ 

Here, |. | denotes the absolute value of a real number. 

a'ib’i + a’ib’i + a' 2 b ' 2 > - J a'i 2 + a " 2 + a ' 2 J bp + bp + b ' 2 2 

(40) 


cos (9(f,hh + 9(g,hh) 


= cos [9{f : hh) cos [9(g, /J))— sin(0(/, h^)) sir 

^{g,hh) 

= a 'i b 'i ~\] 1 - a i\J l - b i 

(41) 

= a[b[ — f a'{ 2 + a 2 2 + a 2 f b '{ 2 + b 2 2 + b 2 

(42) 

< aj&j + a'ib'i + a'ib'i + a' 2 b' 2 

(43) 


= cos (8(f,g)) 

We get equation < mt from equations (01 and ( Ql - Equa¬ 
tions < 1381 and 1391 are used to get El and finally we use 
inequality 1401 to get 1431 . Now, from the monotonicity of 
cos, we have 

e(f,g)<e(f,h")+0(g,h"). (44) 


cos 9(B,V) = sup &{{f,g)} (49) 

/es, 9 er> 

I!/||2=i,||s||2=i 

sup (£/,£><?)} (50) 

/£L 2 [R 3 ],geL 2 [R 3 ] 

||/||2 = l,||g||2=l 

= sup ${(f,BDg)} (51) 

/£i 2 [R 3 ],gSL 2 [R 3 ] 

Il/ll 2 =i,l|g|| 2 =i 

= \\BD\\ 2 (52) 

where (01 is from self-adjointness of B and 03 from the 
definition of the operator norm. ■ 

Proof: [Proof of Theorem |6) 

ll/lll = « 2 ||/lll 

<a 2 (i- 4 r i |u fl |ii;ii^ 

<a 2 (l- e |)- 1 |y R |/3 2 ||/||? 

< a 2 (l — e^j) _1 |VR|/3 2 (l — et) -2 \f\ 

<a 2 (l-e 2 J )- 1 |U i? |/3 2 (l-e T )- 2 |U T l||/|! 2 

We get the last step using the Cauchy-Schwarz inequality. 
Rearranging the above inequality gives the required result. ■ 


Substituting inequalities 03 and 1291 into the above and using 
equation 03 proves the lemma. ■ 

Proof: [Proof outline Theorem H From the definition of 

0(f,g) 


cos (6(f,Df)) 


%{(/.£/)} 

WDfhWfh 


j R{(Df,Df)} 
WDfhWfh 


\\Dfh 

Wfh 


Noting / = Df + / — Df and (/ — Df , Df) = 0. Similarly 
(3 = cos (9{f,Bf)). In order to complete our proof we use 
Lemma ^ Therefore 

cos -1 a + cos^ 1 P = 6>(/, Df) + 9(f, Bf) (45) 
>6(Df,Bf ) (46) 

> 0 o (47) 

where 01 is from Df £ V and Bf £ B and these two 
subspaces have the minimum angle 9q. ■ 

Proof: [Proof of Theorem H The angle between two 

subspaces is 
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= inf 0(f,g) 

f^0,g^0 


9(B, V) 


(48) 













